Skip to main content

Shinji Nishimoto: Reconstructing visual experiences from brain activity evoked by natural movies

Movies Preview

movies
Shinji Nishimoto: Reconstructing visual experiences from brain activity evoked by natural movies


Published October 26, 2011


Talk by Shinji Nishimoto of UC Berkeley. Given to the Redwood Center for Theoretical Neuroscience at UC Berkeley.

Abstract.
Quantitative modeling of human brain activity can provide crucial insights about cortical representations and can form the basis for brain decoding devices. Recent functional magnetic resonance imaging (fMRI) studies have modeled brain activity elicited by static visual patterns and have reconstructed these patterns from brain activity. However, blood oxygen level-dependent (BOLD) signals measured via fMRI are very slow, so it has been difficult to model brain activity elicited by dynamic stimuli such as natural movies. Here we present a new motion-energy encoding model that largely overcomes this limitation. The model describes fast visual information and slow hemodynamics by separate components. We recorded BOLD signals in occipitotemporal visual cortex of human subjects who watched natural movies and fit the model separately to individual voxels. Visualization of the fit models reveals how early visual areas represent the information in movies. To demonstrate the power of our approach, we also constructed a Bayesian decoder by combining estimated encoding models with a sampled natural movie prior. The decoder provides remarkable reconstructions of the viewed movies. These results demonstrate that dynamic brain activity measured under naturalistic conditions can be decoded using current fMRI technology.


Audio/Visual sound, color

comment
Reviews

There are no reviews yet. Be the first one to write a review.
SIMILAR ITEMS (based on metadata)
PubMed Central
by Sawahata, Yasuhito; Komine, Kazuteru; Morita, Toshiya; Hiruma, Nobuyuki
texts
eye 16
favorite 0
comment 0
Source: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3852249
Community Video
by Neurocognitive Networks 2010
movies
eye 172
favorite 0
comment 0
PubMed Central
texts
eye 48
favorite 0
comment 0
Source: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4135209
PubMed Central
texts
eye 20
favorite 0
comment 0
Source: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3995691
Arxiv.org
by Evangelos Karapanos; Jean-Bernard Martens; Marc Hassenzahl
texts
eye 21
favorite 0
comment 0
Source: http://arxiv.org/abs/0912.5343v3
Community Video
movies
eye 383
favorite 0
comment 0
Community Video
movies
eye 457
favorite 0
comment 0
Community Video
movies
eye 636
favorite 0
comment 0